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Abstract 

The spectral densities of the weighted Laplacian, random walk and weighted adjacency matrices as- 
sociated with a random complex network are studied using the replica method. The link weights are 
parametrized by a weight exponent p\ Explicit results are obtained for scale-free networks in the limit 
of large mean degree after the thermodynamic limit, for arbitrary degree exponent and p\ 
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In a network representation of complex systems, their constituent elements and interac- 
tions between them are represented by nodes and links of a graph, respectively. Dynamical 
and structural properties of such systems can be understood first by studying linear prob- 
lems defined on the network. A linear problem on a graph is associated with a matrix and 
the distribution of its eigenvalue spectrum is of interest. The real world networks are usually 
modeled as a random graph. The spectral density, also called the density of states, is the 
density of eigenvalues averaged over an appropriate ensemble of graph. 

In this work, we study the spectral densities of several types of matrices associated with a 
scale-free network which has a power-law tail in the distribution of the number of incoming 
links to a node. The spectral densities in the thermodynamic limit are expressed in terms 
of solutions of corresponding non-linear functional equations and are solved analytically in 
the limit where the average incoming links per node is large. Implications of our results are 
discussed. 



I. INTRODUCTION 



Many real world networks can be modeled as a scale-free network HI, \a\M- In the scale-free 
network, the degree d, the number of incident links to a node, is distributed with a power-law tail 
decaying as ~ with the degree exponent X often in the range 2 < X < 3. Given such a network, 
one can consider several types of matrices associated with linear problems on the network. Many 
structural and dynamic properties of the network are then encoded in the eigenvalue spectra of 
such matrices and hence the distributions of their eigenvalue spectra are of interest. Since each of 
the real world networks may be viewed as a realization of certain random processes, the spectral 
density or the density of states is studied theoretically by averaging them over an appropriate 
ensemble. 

One of such an ensemble is the static model |4|, [50 which was motivated by its simulational 
simplicity. Being uncorrelated in links, it allows easier analytical treatments than other growing 
type models. Other closely related one is that of Chung and Lu flg]. Recently in [7], the replica 
method is applied to study the spectral density of the adjacency matrix of scale-free networks 
using the static model. The expression for the spectral density is derived in terms of a solution of 
a non-linear functional equation which were solved in the dense graph limit p — > oo 5 p being the 
mean degree. The explicit solution shows that the spectral density decays as a power law with the 
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decay exponent Oa = 2X — 1 confirming previous approximate derivations [8] and a rigorous result 
on the Chung-Lu model |^]. 

In this paper, we extend [7] and study three other types of random matrices motivated from 
linear problems on networks. They are the weighted Laplacian W, the random walk matrix R and 
the weighted adjacency matrix B, respectively. We set up the non-linear functional equations for 
each type of matrices and solve them in the dense graph limit p — » °°. For the random walk matrix, 
we find its spectral density to follow the semi-circle law for all X. For the weighted matrices, to 
be specific, the weights of a link between nodes i and j are given in the form of ({di){dj))~$/ 2 
where (di) is the mean degree of node i over the ensemble. This form of weights is motivated 
by recent works on complex networks lioi [ill [12I H [l4 , 15, 16]. When P < 1, we find that the 



effect of |3 on the spectral density is to renormalize X to X = (X — (3) / ( 1 — (3) . The spectral density 
decays with a power law with exponents Ow = X and Og = (2X — 1), for W and B, respectively for 
all X > 2. When (3 = 1, the spectral density of B reduces to the semi-circle law, the same as in R 
while that of W is bell-shaped. When |3 > 1, we find that the spectral densities of W and B show 
a power-law type singular behavior near zero eigenvalue characterized by the spectral dimension 
(X-1)/(P-1). 

This paper is organized as follows. In section 2, we generalize [7j] in a form applicable to 
other types of matrices and present general expressions for the spectral density function in terms 
of the solution of non-linear functional equation. In sections 3, 4, and 5, we define and solve the 
weighted Laplacian, the random walk matrix and the weighted adjacency matrix, respectively, in 
the large p limit. In section 6, we summarize and discuss our results. 



H. GENERAL FORMALISM 



We consider an ensemble of simple graphs with /V nodes characterized by the adjacency matrix 
A whose elements Ajj = Aji (i ^ j) are independently distributed with probability 



P(A ij )=f i jd(A ij -l) + (l-f ij )b(A i j) 



(1) 



and An = 0. The degree of a node i is di = Y^jMj and (...) below denotes an average over the 
ensemble. 

In the static model of scale-free network flj], fij is given as 



fij=l-exp(-pNP i P J ), 



(2) 



where P; °c i ^ (k > 2) is the normalized weight of a node i = 1,. . .,N, related to the expected 
degree sequence as (dj) = pNPj, and p = /N is the mean degree of the network. The degree 



distribution follows the power law ~ d . The Erdos-Renyi's (ER's) classical random graph Ill7ll 
is recovered in the limit X —> °°, where Pi = l/N which is called the ER limit below. In the model 
of Chung and Lu M, fij is taken as = pNPjPj , with/ 5 / °< (/ + i )-V(*--i). when 2 < X < 3, i 
should be 0(N^~^^ 2 ) to satisfy fj < 1 introducing an artificial cut-off in the maximum degree. 
In the following, we use the static model for ensemble averages but final results are the same for 
the two models in the thermodynamic limit N — »■ °°. 

Given a real symmetric matrix Q of size N associated with a graph, its spectral density, or the 
density of states, Pg(/j) is obtained from the formula 

where 

z q m = /~ (n d( ^ ex p f^Etf - \ Emm>/1 ( 4 ) 

with lm/j — > + . For a class of matrices considered in this work, Zg can be written in the form 

Zq(m) = /_~ (ri d( ^ ex P (x>(4*) + E^(<fc,<M j . (5) 



Then following II 1 811 and |7|] we arrive at the expression 

2 3 1 N f ( 
PgO") = — Im ^-^ E ln / d > ex P ( E^(^a) +pNPig Q {Q> a } 



(6) 



d^ =1 

where a=l, . . . , n is the replica index, the limit n — > is to be taken after, and gg{(|)a} is a solution 
of the non-linear functional integral equation 

i _ V d /d nx K ex P(La^( ( l ) a) Yoc)) — l)exp(£ a 
geWat /d"Vexp(Ea*/(Va)+^«fi{Va}) 

The derivation is valid when 5,j = exp(£ a V((|); a ,(|)/a)) — 1 satisfies the factorization property, that 
is, when Sy can be expanded into the form 

Sij = Y t a J°j($il,---tyn)°j($jh---tyjn), (8) 
J 

where J denotes a term of the expansion, aj and Oj its coefficient and corresponding function, 
respectively. A crucial step in this derivation is the use of log(l + fijSij) « pNPiPjSjj. This 



introduces a relative error of < 0(N 2 ~^logN) for 2 < X < 3 in both the static model and the 
Chung-Lu model and is neglected in the thermodynamic limit |18, l^] . 

If V((|),y) has the rotational invariance in the replica space, we may look for the solution of 



gg{(|) a } in the form of gg(x) with x = a/Loc ^a- Then the angular integral can be evaluated and 
the n — > limit can be taken explicitly. The sums over nodes are converted to integrals using 

In the following sections, we apply this formalism to obtain formal expressions for the spectral 
densities of several types of matrices and evaluate them explicitly in the large p limit. When \jl is 
scaled to another variable E, we use the convention Qq(E) = pQ{ji){dfx/6E) so that / QQ(E)dE — 
1. 



III. WEIGHTED LAPLACIAN 

The weighted Laplacian W considered in this section is defined as 

di&j / Ai j 



(10) 



where A is the adjacency matrix and dj = EyA^ is the degree of node i, and qt are arbitrary positive 
constants. This is motivated by the linear problem of the type 



¥f = -lrj:M*i-*j) = -lFij*j, 

u * Hi ; ; 



(11) 



where Wtj = (dfiij —A^/qi. For example, in the context of the synchronization, the input signal 



to a node from its neighbors may be scaled by a factor df [[12 



160, which may be approximated 



13J]. Also the problem has relevance 



as {di)$ Il20h or to an average intensity of weighted networks 
to the Edward-Wilkinson process on network |150. W and W are similar to each other since 
W = S l l 2 WS~ x l 2 with S the diagonal matrix with elements Su = qi. Eigenvalues of W are positive 
real with minimum at the trivial eigenvalue 0. 

When qj = 1 for all i, W reduces to the standard Laplacian L defined by 



di&ij A/;. 



(12) 
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In the literature, the Laplacian is sometimes defined by the normalized form 



/ djdj 







if i = j and di 7^ 0, 
ifAy = l, 

otherwise. 



(13) 



We call R = I — L the random walk matrix in this work and discuss it in the next section. We men- 
tion here that W is a weighted version of the Laplacian of unweighted graphs while the Laplacian 



of weighted graphs would have been defined by Qj = (T,k^ik/ \/qi<lk)^ij y^Wj 112 



14] 



For Q = W in ©, Zw(n) can be brought into the form © by a change of variable (]) — > y/qify, 
with hi(§) = j^qity 2 and V((|),\|/) = — j(§ — \|/) 2 . Inserting these into © and ©, and evaluating 
the angular integral, we obtain 

1 



1 r°° i 

Pw(m) = ^ Re L^y o yexp(-w,-y 2 + pNPig w (y))dy 



(14) 



with 



2 r°° i 
-xc- LX ,2 %Pij Q Ji{xy)^{-my 2 -^y 2 +pNPigw(y))^ (15) 



where 7i (z) is the Bessel function of order one. In the ER limit (NPj = 1) and q, ■ = 1, (fl4l) and (fT5l) 
reduce to equations (17) and (16) of 112 respectively. 

The dense graph limit p — > °° is investigated by using the scaled function Gw(jc) = pgw(x/y/~P~)- 



Then in the limit p — > °°, Gw(jc) = — ^jc 2 and 

1 



-ImY 



(16) 



7t/V ypNPj-nqi 

for arbitrary To be specific, we now set q\ = (dj)$ = (pNPj)$ at this stage. (3 is arbitrary and is 
called the weight exponent here. When the eigenvalue is scaled as 



E = pV- l (X-2)V- l (\-l) 1 -^, 



(17) 



we find the spectral density in the dense graph limit as 



pw{E) = Im 



1 M x-p-i 



-du. 



n Jo l-u l -$E 
This shows qualitatively different behaviors in the three regions of p\ 



(18) 
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FIG. 1: (Color online) The spectral density of the weighted Laplacian for weight exponent [3 < 1 (a), [3 = 1 
(b), and p > 1 (c). In (a) and (c), a typical curve is shown as a function of E while in (b), the spectral density 
is shown as a function of E = ^fp{E — 1) for several values of X. 

(i)P<l: 

Eq. (fl~8l) is evaluated as 



Pw(E) 



if 0< £" < 1, 

(^i^-MVU-P) if £>i. 

Therefore, the spectra has a finite gap in E and a power-law tail with an exponent Ow = (A, 
P)/( 1 — (3). The only effect of P here is to renormalize A to 

A-p 



(19) 



1-P' 



(20) 



Fig. [2 a) shows the graph of pw(E) for A = 3. 
(ii)P=l: 

The case P = 1 needs a special treatment. When P = 1, E = /u and pw(E) = 8(2? — 1). However, 
if we expand the region near E = 1 by introducing a new variable £ by E = y/p(E — I ) , we obtain 
non-trivial values for finite E. The method and result are similar to that treated in j2l\\ for the ER 
case. Following |21|1. the function gw(x) in Eq. (15) is written in terms of H(x), defined by 



P8w(p 



-1/4, 



-iy/px 2 /2-x 4 /S+H(x). 



(21) 



Then in the limit p — > °°, (fT3T) gives //(x) = iy(£ , )x 2 /2 and (fl~4)) gives pwK-E) = Imy(£') /%, where 
y(£') is the solution of 



(x-i; 



27i y- 



dze 



u x ~ 2 du 



o £ + y+zv/w(A-l)/(A-2)' 



(22) 



Fig. 01b) shows the graph of pw(E) for several values of X. 
(iii)P> 1: 

In this case, ([TBI is evaluated as 



(£nl)£(X-P)/(P-l) if < J E<l 
p w (£)H V P- lJ (23) 
if£ > 1. 

Thus pw(E) is non-zero for < E < 1 with a simple power. Such power-law dependence near the 
zero eigenvalue gives arise a long-time relaxation ~ t~^ s with the spectral dimension [|22j, 

23 



23 



24 



^ = |zY- (24) 

Figfflc) shows the graph of pw(E) for X s = 3. 

IV. RANDOM WALK MATRIX 

Consider a random walk problem defined as follows: When a random walker at a node i sees di 
neighbors, it jumps to one of them with equal probability. When a node i is isolated so that di = 0, 
the random walker is supposed not to move. Then the transition probability from node i to j is 
given by R { j = A (J /J, if dj ^ and Rjj = 8y if dj = 0. R can be brought into a symmetric form by 
a similarity transformation 7? = r 1//2 /?r~ ! / 2 , where T is the diagonal matrix with elements 7], = 1 
when di = and 7y = J, when J, 7^ 0. The resulting symmetric matrix 7?, called the random walk 
matrix here, is 

1 if / = j and dj = 0, 



R 



i 



ifAy = l, (25) 



otherwise. 

Being similar, 7? and i? have the same set of eigenvalues that are located within the range < 1. 

The isolated nodes integrate out of the partition function Zr(/j) in ©, giving an additive term 
nod(/j — 1 ) in the spectral density Pr(/j) where no is the density of isolated nodes. For the remaining 



nodes, Rij =Ajj/ w djdj and, after a change of variable §j — »■ ydifyi, Zr(/j) can be brought into the 
form © with V(§, V|/) = ^u((|) 2 + \|/ 2 ) — i(|n|/ and hj(§) = — e(|) 2 with £ — > + to ensure convergences. 
Since A (J = anyway for isolated nodes, the sums in © is extended to all nodes. Plugging this 
into © and ©, we find 

Mm) = no8(ji- 1) + ^ReJ^Pi rygR(y)exp(pNPi[g R (y) - l])dy (26) 

K i JO 



with 



g R (x) = e 1 ^ / 2 -x^Pi / Ji(xy)exp(-v(x 2 + y 2 ) + pNP l [g R (y) - l])dy. (27) 

When p — > oo, all nodes belong to the percolating giant cluster pO and no vanishes. To obtain 
the spectral density in the limit p — > °°, we scale /j = p~ l / 2 E and g«(jc) = 1 + G/j^p 1 / 4 *) / p. Then 
from (1271) . Gr(jc) is determined as Gr(x) = —ax 2 /2 with a being a solution of a 2 + iEa — 1=0 
and from (l26l) . p^(£') = ~Re,(%a)~ l . This gives the semi-circle law for all X: 



P^) = iY 1 ~T (28) 



for |£| < 2 and otherwise. 



V. WEIGHTED ADJACENCY MATRIX 

In this section, we consider the weighted version of A defined by 

B tJ = -^=, (29) 
where qi are arbitrary positive constants. This is motivated by the weighted networks whose link 
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weights are product of quantities associated with the two nodes at each end of the link 
Later on for explicit evaluations, we take qi to be qi = (di)$ = (pNPi)$ with arbitrary p\ When 



P = 0, we recover A treated in QVU while when (3=1, Bjj = Ajj/ y/ (di) (dj) may be considered as 
an approximation to R and is treated in With a change of variable (|), — > ^Jqifyi in ©, Zg is of 
the form © with hi(§) = jfjq^ 2 and V((|),\|/) = Then we find 

C°° i 

p B (/u) = — ReJ> / vexp(- W; y 2 +p/Y/'^ fi (3;))d3; (30) 
TIN ~ Jo 2 

with 

r°° i 

8B(x) = -Y,Pi xJi{xy)zxv{- mi y 2 + pNP igB (y))&y (31) 
i 2 

for arbitrary q\. 

Specializing to the case where qi = (dj)$ = (pNPi)$, the limit p — > oo is investigated by scaling 
p to E by 

£ = /-5(X-2)P- 1 (X-l) 1 - p A ', (32) 
andg fi (x) = G B (p 1/4 x)/p. Then G s (jc) = -^££(£)jc 2 and 

p s (£) = --Im£ 2 (£) (33) 
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FIG. 2: (Color online) The spectral density of the weighted adjacency matrix with weight exponent [3 < 1 
in (a) and [3 > 1 in (b), for several values of effective degree exponents X (a) and X s (b), respectively. 



with b(E) as the solution of 



E 2 b=(X-l) f 1 " du. (34) 

In the ER limit, we recover the semi-circle law regardless of |3. For finite X, we consider three 
regions of [3 separately. 

(i)P< 1: 

A change of integration variable in (l34l) leads to 

X-l 1 



2F1 1 



-b 2 E 2 



(35) 



where 2^i(l,c — l;c;z) = (c — 1) / ? c ~ 2 /(l — ?z)dz is the hypergeometric function. Eq. (1351) is 
a generalization of OD which is a special case of (3 = 0. One notes that the effect of |3 is again to 
renormalize X to X = (X. — J3)/(l — (3) and the results of |7|] applies here when its degree exponent 
is replaced by the effective one. In particular, the spectral density is symmetric in E, has the 
power-law tail ~ \E\~ aB with an exponent 

2X-P-1 



a B = 2X-l 



1-P 



(36) 



and an analytic maximum (X — 1)/ (X%) at £ = 0. Fig.^a) shows the graph of Pb(E) for several 
values of X. 
(ii)P = l: 

In this case, £ in (l34l) is simply determined from £ 2 Z? = 1/(1 —b) and the spectral density 
becomes the semi-circle law: 

p B (E) = -\ll 



£2 

T 



(37) 
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for \E\ < 2 and for > 2 for all A. The same is proved in [9] for sufficiently large but finite p 
while we have taken the limit p — > °°. B at P = 1 being an approximation of R, it is not surprising 
to see the same results for the two cases. 
(iii)P>l: 

In this case, it is convenient to bring ( |34l ) into the form 

E 2 = (^^j^ 2 F l (\X+UK + 2-,b). (38) 

with X s = (A — 1)/(P — 1). The right hand-side of (1381) as a function of real b takes a minimum 
value £^ at < £ c < 1 and increases to infinity as b — > + or — »■ 1 . Thus for > 2s c , is 
real and Pb(E) = 0. As \E\ decreases from E c , Pb(E) rises with a square root singularity since the 
righthand side of (l38l) is analytic at b c . It is interesting to note that the behavior of Pb(E) at E = 
is non-analytic. When < X s < 1, it diverges as 

Pb(E)~ ) s \E\-V-» (39) 
2cos(5Aj) 

while, for X 5 > 1, its singular part is masked by the analytic part and it takes the finite maximum 
value 

PJ»(0) = l^-r- (40) 

71 A v — 1 



At X s = 1, it diverges logarithmically: 



p B (E) ~-log-L. (41) 

7C \E 



Fig.[2tb) shows the graph of Pb(E) for several values of X s 



VI. SUMMARY AND DISCUSSION 



In this work, we derived the spectral densities of three types of random matrices, the weighted 
Laplacian W, the random walk matrix R, and the weighted adjacency matrix B, of the static model 
in the dense graph limit after the thermodynamic limit. Our results apply to the model of Chung- 
Lu also. In fact, they apply to other models as long as in (1) is a function of pNPjPj and satisfy 
fij < pNPiPj. 

With weights of the form q\ = (dj)$, they show varying behaviors depending on the degree 
exponent A and the weight exponent p\ The spectrum follows the semi-circle law for R, and at 
the |3 = 1 point of B for all A. The P = 1 point of W is closely related to / — B or / — R, but its 

11 



spectral density is not of the semi-circle law but is bell-shaped. When (3 < 1, the degree exponent 
is renormalized to % given in (l20l) and the spectral density shows a power law decay with exponent 
Ow = A and a B = 7X — 1 for W and B, respectively. When the eigenvalue spectrum has a long 
tail decaying as ~ fx~ a , the maximum eigenvalue of a finite system is expected to scale with N 
as r ^ iV^^ ' while the natural cutoff of degree in the scale-free network is £/max ^ 
The maximum eigenvalue of the weighted Laplacian W may be taken as Wu ~ rfmax for (3 < 1 
in the first order perturbation approximation. This simple argument explains the power of the tail 
Ow = A, = (k — (3)/(l — (3) for W. A similar argument applied to (B 2 ) n ~ J ma | gives the decay 
exponent Ob = 2A — 1 for B. 

When (3 > 1 , the spectral densities of W and B are non-zero within a finite interval of the scaled 
eigenvalue E and are associated with the spectral dimension k s given in (1241) . For W, it is a simply 
power ~ E^ s ~ 1 in < £ < 1 , while for B, it is symmetric in E and singular at \E \ = with exponent 
X s — 1 . They both diverge as E — ► when < A v < 1 . 

When p is finite, the spectra is very complicated and is not well understood. For small p at 
least, one expects infinite number of delta peaks on the spectrum Jl^]. In the dense graph limit 
p — ► °o, those delta peaks have disappeared. Even though our explicit results are for the limit 
p — >• oo 5 the limit is taken after the thermodynamics limit Af — > °°, and physically they would be a 
good approximation for 1 p -C in finite systems. In the synchronization problem on networks, 



the eigenratio R — unIhi of W is of interest Il27h . From (fT9l ), one may estimate /j^ ~ ./V 1 - 1 



l-l) 



and In/? ~ Jr? IniV for (3 < 1, assuming that A^-dependence of /J2 is slower than the power law. 
Similarly, from (1231) . one gets \nR ~ jM-lnAf for (3 > 1. Such ^-dependence of R is corroborated 



with numerical results for a similar matrix studied in 



120- 



The spectral properties of Laplacian on weighted networks, Qj =JJLkMik)^>ij or i ts nor 



malized version Dij = 8,j — By/ \jY*kBikY*kB jk are also of interestlll3l. 11411 . Unfortunately, the 
formalism leading to © and © cannot be applied to these cases since the factorization property 
© is not satisfied. 
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